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'"O . Abstract. We study the tailoring of structured random graph ensembles to real 

networks, with the objective of generating precise and practical mathematical tools 
for quantifying and comparing network topologies macroscopically, beyond the level 
of degree statistics. Our family of ensembles can produce graphs with any prescribed 
' O ' degree distribution and any degree-degree correlation function, its control parameters 

can be calculated fully analytically, and as a result we can calculate (asymptotically) 
| formulae for entropies and complexities, and for information-theoretic distances 

between networks, expressed directly and explicitly in terms of their measured degree 
, distribution and degree correlations. 
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ON l. Introduction 

o ■ 

In the study of natural or synthetic signaling networks, one of the key questions is how network 
^ . structure relates to the execution of the process which it supports. This is especially true 

in systems biology, where, for instance, our understanding of how the structure of protein- 
protein interaction networks (PPIN) relates to their biological functionality is vital in the 
design of a new generation of intelligent and personalized medical interventions. In recent 
years, high-throughput proteomics has allowed for the drafting of large PPIN data sets, for 
different organisms, and with different experimental techniques and degrees of accuracy. With 
this accumulation of information, we now face the challenge of analyzing these data from a 
complex networks perspective, and using them optimally in order to increase our understanding 
of how PPIN control the functioning of cells, both in healthy and in diseased conditions. A 
prerequisite for achieving this is the availability of precise mathematical tools with which to 
quantify topological structure in large observed networks, to compare network instances and 
distinguish between meaningful and 'random' structural features. These tools have to be both 
systematic, i.e. with a sound statistical or information-theoretic basis, but also practical, i.e. 
preferably formulated in terms of explicit formulae as opposed to tedious numerical simulations. 
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Many quantities have been proposed for characterizing the structure of networks, such 
as degree distributions [1], degree sequences [2], degree correlations |3j and assortativity 
[I], clustering coefficients [5], and community structures [6]. To assess the relevance of 
an observed topological feature in a network, a common strategy is to compare it against 
similar observations in so-called 'null models', defined as randomized versions of the original 
network which retain some features of the original one. The choice of which topological 
features to conserve in the randomized models was mostly limited to degree distributions and 
degree sequences. Such null models were used to assess the statistical relevance of network 
motifs in real networks, viz. patterns which were observed significantly more often in the 
real networks than in their randomized counterparts [9]. Whether any such proposed 
motif is indeed functionally important and/or represent (evolutionary) arisen principles, is 
however not obvious; topological deviations from randomized networks could also be merely 
irrelevant consequences of some neglected structural property of the network, i.e. the result of 
an inappropriate null hypothesis rather than of a distinctive feature of the process [101111]. The 
definition and generation of good null models for benchmarking topological measures of real 
world graphs (and the dynamical processes which they enable) is a nontrivial issue. Similarly, 
in comparing observed networks (which, as a result of experimental noise, will usually not 
even have identical nodes), one would seek to focus on the values of macroscopic topological 
observables, and know the typical properties of networks with the observed features. 

In recent years there have been efforts to define and generate random graphs whose 
topological features can be controlled and tailored to experimentally observed networks. In 
|12j a parametrized random graph ensemble was defined where graphs have a prescribed degree 
sequence, and links are drawn in a way that allows for preferential attachment on the basis of 
arbitrary two-degree kernels. In this paper we generalize the definition of this ensemble, and 
show that it can be tailored asymptotically to the generation of graphs with any prescribed 
degree distribution and any prescribed degree correlation function (and that it is a maximum 
entropy ensemble, given the degree correlations). Moreover, in spite of its parameter space 
being in principle infinitely large, in contrast to most random graph ensembles used to mimic 
real networks, we can derive explicit analytical formulae for the parameters of the ensemble, 
to leading order in system size, expressed directly in terms of the observed characteristics of 
the network given. Graphs from this ensemble are thus ideally suited to be used as either 
proxies or null models for observed networks, depending on the question to be answered. 

Statistical mechanics approaches have been proposed to quantify the information content 
of network structures. Especially the (Shannon or Boltzmann) entropy has been instrumental 
in characterizing the complexity of network ensembles [1'6\ [T^l [To] . Here, the crucial availability 
of analytical expressions for the parameters of our ensemble will enable us to derive explicit 
formulae, in the thermodynamic limit (based on combinatorial and saddle-point arguments), 
for our ensemble's Shannon entropy, and hence also for the complexity of its typical graphs. 
These formulae are compact and transparent, and expressed solely and explicitly in terms of 
the degree distribution and the degree correlations that our ensemble is targeting. Finally, 
along similar lines we can obtain an information theoretic distance between networks, again 
expressed solely in terms of their degree distributions and degree correlations. A companion 
paper [IB] will be devoted to large scale applications to PPIN data of these complexity and 
distance measures; here we focus on their mathematical derivation. Although there is no need 
for numerical sampling in our derivations (all results can be obtained analytically), we note 
that exact algorithms for generating random graphs from the proposed ensemble exist |17j . 
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2. Definitions and properties of network topology characterizations 

2.1. Networks, degree distributions, and degree correlation functions 

We study networks (or graphs) of N nodes (or vertices), labeled by Roman indices i, j, . . . etc, 
where every vertex can be connected to other vertices by undirected links (or 'edges'). The 
microscopic structure of such a network is defined in full by an N x N matrix of binary variables 
Cij G {0, 1}, where the nodes i and j are connected by a link if and only if Cjj = 1. We define 
Cij = Cji and ca = for all and we abbreviate c = {cjj}. Henceforth, unless indicated 

otherwise, any summation over Roman indices will always run over the set {1, . . . , N}. 

A standard way of characterizing the topology of a network c, as e.g. observed in 
a biological or physical system under study, is to measure for each vertex i the degree 
ki(c) = J2jCij, the number of the links to this vertex. From these numbers then follow 
the empirical degree distribution p(k\c) and the observed average connectivity k(c): 

1 — 1 

p(k\c) = j^Yl S k,ki(c), H c ) = k i( c ) W 

i i 

(using the Kronecker 5-symbol for n,m G K, defined as 5 nm = 1 for n = m and 5 nm = 
otherwise). Objects such as p(k\c) have the advantage of being macroscopic in nature, allowing 
for size-independent characterization of network topologies, and for comparing networks 
that differ in size. However, networks with the same degree distribution can still differ 
profoundly in their microscopic structures. We need observables that capture additional 
topological information, in order to discriminate between different networks with the same 
degree distribution (P). 

To construct macroscopic observables that quantify network topology beyond the level of 
degree statistics, it is natural to consider how the likelihood for two nodes of a network c to 
be connected depends on their degrees, which is measured by the degree correlation function 

V [conn | cj 

Here Pfconnlc, k, k'\ is the probability for two randomly drawn nodes with degrees (k, k!) to 
be connected, and "Pfconnlc] is the overall probability for two randomly drawn nodes to be 
connected, irrespectively of their degrees, viz. 

P[conn|c, k, k'} = E ff % Sk MfvM°) (3) 
IZi^j 0fc,fci(c)<5jfe',kj(c) 

^onn|c] =^^g cy = *& (4) 

By definition, H(k, k'\c) is symmetric under exchanging k and k' . For simple networks Co, 
with some degree distribution p(k) but without any micro-structure beyond that required by 
it is known (see e.g. [18] and references therein) that in the limit N — > oo one finds 

n(fc,fc'|co) = kk'/ k 2 (c). (5) 

It follows that those topological properties of a given (large) network c, that manifest 
themselves at the level of degree correlations and cannot be attributed simply to its degree 



| In section 2 we will give a precise and more general mathematical definition of 'simple networks', 
relative to some imposed macroscopic feature such as the degree distribution p(k). 
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statistics, can be quantified by a deviation from the simple law see also [TJ [H3 [2U]. One 
is therefore led in a natural way to the introduction of the relative degree correlations 

.,. , U(k,k'\c) _ V\ 
|CJ ~ n(jfc,A;'|co) ~ P[conn|c] W~' U 

By definition, II(fc, fc'|co) = 1 for sufficiently large simple networks Co, whereas any statistically 
relevant deviation from H(k, k'\c) = 1 signals the presence in network c of underlying criteria 
for connecting nodes beyond its degrees. Just like p(k\c), IL(k, k'\c) is again a macroscopic 
observable that can be measured directly and at low computation cost. It is therefore a natural 
tool for quantifying and comparing network structures beyond the level of degree statistics. 

2.2. Properties of the relative degree correlation function 

To prepare the ground for proving some asymptotic mathematical properties of the relative 
degree correlation function II(/c, fc'|c), we first simplify the denominator of ([3]): 

y^^fc,fc i fc)^fc / ,fc 1 (c') = X! ^fc,fci(c)^fc',k,-(c) ~ °~kk' ^ fyj,fcj(c) 
i^j ij i 

= N 2 [p(k\c)p(k'\c) - N-Xvpfrlc)] (7) 
Upon inserting the result for (J3|) together with © into ([6]) we then find that 
nffr h '\ c ) - N ' l ^3 c ^kM-) 5 k>Mc) fc(c) x 

and hence, using cu = for all i, 

r j / 1 \ %)Eij^fc,fc«(cA',Ay(c) ... 
hm n(re, «r c) = hm — , . . ,. , , — . (9) 

We are now in a position to establish three identities obeyed by H(k,k'\c). The first two of 
these, viz. (|10ll2p . are the main ones; they are used frequently in mathematical manipulations 
of subsequent sections. The third provides the physical intuition behind (|1UI12|) . It is assumed 
implicitly in all proofs that k(c) remains finite for N — > oo and that the limits N — ► oo exist. 

• Linear constraints: 

VfcGlN: lim V ^M nffc^lc) = 1 (10) 
N->ooj? fc(c) 

These are easily verified for simple graphs Co, for which H(k, fc'|co) = 1 VTc, k' . However, 
they turn out to hold for any graph c, as can be proven using Q as follows: 

lim V fc y' |C W'|c)= Hm X"^«i S >M°) S *M4 
N-oo^ k(c) N^oo Np{k\c)k 

= lim = i- (ii) 

N^oo Np(k\c)k y ' 

• Normalization: 

^t^ E wr m ^ ) -- 1 (12) 

This follows directly from (|10p upon multiplying both sides by kp(k)/{k), followed by 
summation over all k. 
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• Interpretation of the linear constraints: 

lim Y k ^ k ^ IL(k,k'\c) = lim ^-V [conn | c, k] (13) 
N^oo *-rf k(c) N->oo k 

Here ^[connlc, k] is denned as the probability that two randomly drawn nodes, one having 
degree k, are connected: 

p[ CO nn|c, k] = C f kMc) = ^t^ff (1 + 0(N- 1 )) (14) 
22i^j °kMc) N 2 p(k\c) 

The proof is elementary: 

^ fc^|c) X ^ij^kMc ) = ^p [conn | C)fc ] (15) 

We conclude that our first (proven) identity (|1U|) boils down to the claim that for large N 
one has Pfconnlc, k] = k/N (modulo irrelevant orders in N), which is easily understood. 

We end this section with two further observations. First, the relations (jlOp involve the degree 
distribution, so one must expect that the possible values for IL(k, k'\c) are dependent upon (or 
constrained by) p(k\c). Second, several other useful properties of the kernel H(k, k'\c) can be 
extracted from (jlOp . For instance, the only separable kernel II is H(k,k'\c) = 1 for all (k,k'): 
a separable kernel is of the form H(k, k'\c) = G(k\c)G(k'\c) for some function G(k\c) (II being 
symmetric), and insertion of this form into (jlOp leads immediately to G(k\c) = 1 for all k,c. 



3. Random graphs with controlled macroscopic structure 

3.1. Definition of the random graph ensembles 

To study the signalling properties of real-world networks, or generate 'null models' to assess 
the relevance of observed topological features, one needs random graph ensembles in which 
one can control the topological characteristics one is interested in and 'tune' these to match 
the characteristics of the observed networks. Most ensembles studied in literature so far have 
focused on producing graphs with controlled degree statistics. The suggestion that ([6]) can 
be used for identifying network complexity beyond degree statistics goes back at least to 
[TJ E3 [13 [20] . In contrast to these earlier studies, which were mostly limited to measuring ([6]) 
for real networks, here we take further mathematical steps that will allow us to use ([6]) as a 
systematic tool for quantifying complexity and distances in network structure beyond degree 
statistics. This requires generating random graphs in which we can control at will both the 
degree distribution p(k) and the relative degree correlations H(k,k'). 

It will turn out that we can achieve our objectives with the following random graph 
ensembles, in which all degrees ki are drawn randomly and independently from p(k), and 
where in addition the edges are drawn in a way that allows for preferential attachment on the 
basis of an arbitrary symmetric function Q(k, k') of the degrees of the two vertices concerned: 

Prob(c|p,Q) = £Prob(c|Q,k)nP(fci) (16) 



k ( k \ 

—Q(k t ,kj)5 CiJ ,i + ( 1-—Q(ki,kj) \ S Cijj0 



II^Mc) ( 17 ) 



Here Z(k, Q) is a normalization constant that ensures ^ c Prob(c|k, Q) = 1 for all (k, Q), k = 
N^ 1 J2i ki, and the function Q must obey Q(k, k') > for all (k, k') and iV -2 J2ij Q(ki, kj) = 1. 
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The ensemble (fTT|) with prescribed degrees k = (ki, fc/v) was defined and studied in [T2"ll2"T]. 
We note that in the above ensemble one will have k = J2kP( k ) k + 0(N-^ 2 ). 

Upon making the simplest choice Q(k, k') = 1 for all (k, k') one retrieves from (|16p the 
'flat' ensemble, where once the individual degrees are drawn randomly from p(k), all graphs c 
with the prescribed degrees carry equal probability: 

probw = £ [n^)i v n ny (c) • (i8) 

k L i J Z^c' Hi °k i ,k i (c / ) 

This follows from the property that for Q(k, k') = 1 the factor Ili<j[- • • $cij,i + • • • <5 Cij ,o] in (fT6j) 
depends on c via the degrees {fcj(c)} only, and will consequently drop out of the measure fTTj) : 

n + p - f >M - - 1) ^-"es— « [*<-*'-] 

= (i_|)^ (7V - 1) e ^io S [|(i-lr 1 ] (19) 

Asymptotic properties of the ensembles 

One should expect that macroscopic physical observables such as p(k\c) ([T]) and IL(k, k'\c) (|SJ) 
are self-averaging, and can therefore be calculated, to leading order in N, in terms of their 
expectation values over the ensemble (|16jl §l. We should therefore find that each graph drawn 
from (|16p will for sufficiently large N have as its degree distribution p(k) and will have relative 
degree correlations identical to 

IL(k,k')= lim y"Pmb(c\p,Q)U(k,k'\c) 



(k) 1 



p(k)p(k')kk' N^oo N ' c 

It turns out that (|20p can be calculated analytically, and expressed in terms of p(k) and 
Q(k,k'). The first published result related to this connection in an appendix of [12] was 
unfortunately subject to an error; see the corrigendum [21J for the correct relation as given 



below, of which the actual derivation is given in Appendix A of this present paper: 



a ^">-FiMmo) (21) 

where the function F(k\Q) is calculated self-consistently, for any Q(k,k'), as the solution of 
«: F W a = ^p<V)tf«*$. (22) 

It is satisfactory to observe, upon eliminating Q(k,k') from (|22p via (|2ip . that (|22p becomes 
identical to the set of relations (jlOp that we derived earlier for II(A;, k') solely on the basis of 
the latter's microscopic definition. Clearly, (jlOp must indeed hold for every single graph of the 
ensemble (|16|) . provided is sufficiently large. On the other hand, for finite ./V a typical graph 
of the ensemble (|16p will display deviations from (|21|) that are at least of order 0(N^ 1 ) (the 
difference between definition ([8|) and its asymptotic form ([9|)), but possibly of order 0(N~ 1 ^ 2 ) 
(the typical finite size corrections in empirical averages over 0{N) independent samples). 

§ Proving this self-averaging property explicitly for the ensemble (TTB]) is trivial in the case of p{k\c), 
and nontrivial but feasible in the case of II(fc, k'\c) 
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Expression (|21|) also provides en passant the explicit proof that for graphs in which 
the only structure is that imposed by the degree sequence, viz. those generated from (|18p 
corresponding to Q(k, k') = 1 for all (k, k'), one indeed finds H(k, k') = 1 for N — > oo. Upon 
inserting Q(k,k') = 1 into condition ()22[) we find that F 2 (k) = 1 for all k, upon which the 
desired result follows directly from (|2ip . 



Asymptotically (i.e. in leading relevant orders in N), the probabilities (|16p to find graphs 
c with the correct degree statistics, i.e. with degrees drawn randomly from p(k), depends on 
c via the degree distribution p(k\c) and the kernel U(k,k'\c) only. To see this we study the 
following function for large N, 

Q(c\p,Q) = - A^logProb^Q) = -N' 1 log E JJ [p(fci)<5 fc . )fc . (c) ] e -™(c\k,Q) 

k i 

= ~ E ^P(ki(c)) + 0(c|k(c), Q) (23) 

i 

The leading order in 0(c|k, Q) = —N^ 1 logp(c|k, Q) was studied in [12]. If k(c) 7^ k one has 
f2(c|k, Q) = 00 (the degrees are imposed as strict constraints), whereas for k = k(c) one has 

n(c|k, Q) = -Bog N + h[\ogk - 1] - iv- 1 E U + a^ 1 E k i lo s F (h\Q) 

i i 

- N- 1 E dj log Q(h, kj) + OiN- 1 ) 

i<j 

= h log N + h[log k - 1} - N- 1 J2^og hi + N-^ki log F(k t \Q) 

~ i i 

-^^gQ(k,k')^J2 c ^ 6 ^k',k J +0(N- 1 ) (24) 

kk' ij 

where k = N~ 1 '£2 i ki. We introduce the further short-hand p(k) = N~ 1 Yli&kfai as web 1 as 
the notation o(l) to denote finite size corrections that obey limN^oo o(l) = (to determine 
the exact scaling with N of these corrections we would have to inspect e.g. the finite size 
corrections to (|2ip ). We write the leading orders of (|24p in terms of the kernel n(/c, fc'|c), 
using ([9]) and (j2"Tj) . and substituting into (f2Tj) the present degree distribution p(k), and find 

fi(c|k, Q) = \k\og N + \k[\ogk- 1] - Y,p(k) log A;! + ^p{k)k logF(k\Q) 

- 5 E ^ ^O^ -1 E CijtikMcfaMc) + 

= -jfelogiV + -jfepoglfe- 1] - ^p(k) log k\ + ^p(A:)A:logF(A;|Q) 
22 fc fc 

- E ^ (fc) ^ /)fcfc n(fc, fc'|c) log[II(fc, fc / )F(A;|Q)F(A; / |Q)] + (1) 
fefc' 2k 



1-klogN + -fc[logfc- 1] - E^( fc ) l°g fc! 



LA 7 J 



+ X>(*o* log F(fc|Q) [i-e ^2^n(fc, fc'ic) 
fc k> k 

- E ^^n(fc, jfic) log n(fc, fc') + o(i) 
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= —k log N H — fc[log fe — 1] — y^p(fc) log fe! 
2 2 fc 

- E ^§^n(fc, fc'|c) log U(k, k!) + o(l) (25) 
kk' Ik 

where in the last step we used the identities (jTUJ) . It subsequently follows ([23]) as 

n(c\p,Q) =-k(c)logN + -k{c)[\ogk(c)-l]-J2p( k \ c ) l °Sk ] - (26) 

22 k 

-fi[p(c),n(c);p,n] +o(l) (27) 

o[p(c),n(c); P ,n] = E g^M^M n(fc, fc'|c) log n(fe, fc') (28) 
fefc' -^ c J 

+ 5>(fc|c)logp(fc) (29) 

k 

with fc(c) = J2k kp(k\c), 11(c) = {Il(fc, fc'|c)}, and p(c) = {p(k\c)}. The leading order 
7jA;(c) log iV in Q(c\Q,p) reflects the property that the number of finitely connected graphs 
grows asymptotically with N as exp[~iV log N]. The next order is found to depend only on 
the macroscopic characterization {p(c), 11(c)} of the specific graph c, and on the macroscopic 
characterization {p, 11} of typical graphs from (|16p . with II calculated for the kernel Q via (|2ip . 



3.3. Existence and uniqueness of tailored ensembles 

We will now prove that for each degree distribution p(k) and each relative degree correlation 
function IL(k, k') there exist kernels Q(k,k') such that their associated ensembles (|16p will 
for large N be tailored to the production of random graphs with precisely these statistical 
features. We identify these kernels and show that they all correspond in leading order in N to 
the same random graph ensemble. 

• Existence of a family of tailored kernels: 

For each non-negative function (j)(k) such that p(k)(ft(k)Tl(k, k')4>{k')p{k') is nonzero for 
at least one combination (k,k'), the following kernel satisfies all conditions required to 
define a random graph ensemble of the family (|16|) that generates graphs with degree 
distribution p(k) and relative degree correlation function H(k, k') as N — > oo: 

Q{K y) = HkMKk'm 1 ) z = sr P (k)mm, k'mw) m 

kk' 

Q(k, k') is by construction non-negative, symmetric, and correctly normalized. Also we 
will always find Z > due to Tl(k,k') > in combination with our conditions on cp(k) 
and the normalization (|12p . Recovering the correct degree distribution is built into the 
ensemble (|16j) via the degree constraints. To prove that equations (|21|22p are satisfied 
we define F(k\Q) = 4>{k)/\fZ, and use the fact that by virtue of (f2Tj) the condition ([22]) 
reduces to (flOl) . and is therefore guaranteed to hold, provided TL(k, k') indeed represents 
a relative degree correlation function. 

What remains is to show that there exist functions <j)(k) that meet the relevant conditions. 
The simplest candidate is cp(k) = k/{k), for which we find Z = 1 via (|12p and which is 
easily confirmed to meet all criteria. It gives what we will call the canonical kernel: 

Q*{k, k') = H{k, k')kk'/(k) 2 (31) 
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Completeness of the family of tailored kernels: 

The set of kernels denned by (|30p is complete: if a kernel Q(k, k') generates random 
graphs with statistics p(k) and n(£;, k'), then is must be of the form (I30p . 

The proof is simple. If Q(k, k') generates graphs with relative degree correlation function 
II(A;, k'), according to (|2~TT) it must be of the form Q(k, k') = F(k)Il(k, k')F(k') for some 
function F(k). Since both H(k, k') and Q(k, k') must be non-negative, the same must be 
true for F(k). Hence Q(k, k') is also of the form (|30|) . with (j)(k) = \/~ZF{k) and with the 
formula for Z in (|30p satisfied automatically due to Q(k,k') having to be normalized. 

A further corollary is that all kernels tailored to the generation of graphs with statistics 
p{k) and n(A;, k') are related to the canonical kernel (|3ip via separable transformations, 
with suitably normalized non-negative functions G(k): 

Q(k, k') = G{k)Q*{k, k')G{k') (32) 
Asymptotic uniqueness of the canonical ensemble: 

The random graph ensembles of all kernels of the family (|30p . tailored to generating 
random graphs with statistical properties p{k) and H(k,k'), are asymptotically (i.e. for 
large enough N) identical: if all {ki} are drawn randomly from p(k), and Q(k, k') belongs 
to the family (|3U|) with canonical member Q*(k,k') defined in (|31|) . then 

[Prob(c|p, Q)] 1/N = [Prob(c|p, Q*)] 1/iV e°W (33) 



This follows from (J27J), which tells us that in the two leading orders in N the probabilities 
of graphs generated from (I30p depend on the kernel Q(k,k') of the ensemble only via its 
associated function IL(k, k'), so that iV _1 log Prob(c|p, Q) — iV _1 log Prob(c|p, Q*) = o(l). 



The above results imply that we may regard the random graph ensemble (I16p . equipped 
with the kernel (|31|) . as the natural ensemble for generating large random graphs with 
topologies controlled strictly by a prescribed degree distribution p(k) and prescribed relative 
degree correlations U(k,k'). We will call p(c\p,Q*), with Q*(k,k') = U(k,k')kk' / {k) 2 , the 
canonical ensemble for graphs with p(k) and Tl(k,k'). Note that for U(k,k') = 1 one has 
Q*(k,k') = kk'/(k) 2 , which is indeed equivalent to the trivial choice Q(k,k') = 1 (as it is 
related to the latter by a separable transformation). 

We can now also define what we mean by 'null models'. Given the hypothesis that a 
network c has no structure beyond that imposed by its degree statistics, the appropriate null 
model is a random graph generated by the canonical ensemble with degree distribution p(k) = 
p(k\c) and relative degree correlations n(/c, k') = 1 (giving the trivial kernel Q(k, k') = 1; these 
are usually referred to as 'simple graphs'). Similarly, given the hypothesis that a network has 
no structure beyond that imposed by its degree statistics and its degree-degree correlations, 
the appropriate null model is a random graph generated by the canonical ensemble with degree 
distribution p{k) = p{k\c) and relative degree correlations H(k, k') = H(k, k'\c). 

Finally, self-consistency demands that p(k) and the canonical kernel (or a member of 
its equivalent family, related by separable transformations) are also the most probable pair 
{p, Q} in a Bayesian sense. The probability Prob(p, Q\c) that a pair {p, Q} was the 'generator' 
of c via (|16p can be expressed, via standard Bayesian relations, in terms of the probability 
Prob(c|p, Q) of drawing c at random from (|16p : 

p ,/ nn _ Prob(c,p,Q) _ Prob(c|p, Q)Prob(p, Q) 

{P ' V ' Cj Prob(c) £q< E p < Prob(c|j/, Q', )Prob(p', Q>) ^ j 
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The most probable pair {p, Q} is the one that maximizes logProb(p, Q\c) = logProb(p, Q) + 
log Prob(c|p, Q) (modulo terms independent of {p, Q}), so in the absence of any prior bias, 
i.e. if Prob(p, Q) is independent of {p, Q}, it is the kernel that maximizes Prob(c|p, Q). Since 
J2 C Prcb(c|p, Q) = 1 for any {p, Q}, finding the most probable {p, Q} for a graph c boils down 
to finding the smallest ensemble of graphs compatible with the structure of c. Intuitively this 
makes sense: a more detailed characterization of the topology of an observed graph allows for 
more information being carried over from the graph to the ensemble, reducing the number 
of potential graphs allowed for by the ensemble. The smaller the number of graphs in the 
ensemble, the more accurate will these graphs be when used as proxies for the observed one. 

Maximizing Prob(c|p, Q) over {p, Q} means minimizing £l(c\p,Q) in (|23p . of which the 
leading orders in ./V are given in (|27p . Demonstrating Bayesian self-consistency of our canonical 
graph ensemble for large N hence boils down to proving that the maximum of (|29p over {p, U} 
(subject to the relevant constraints) is obtained for {p, 11} = {p(c), 11(c)}. The constraints 
include the set (jlOp . There are clearly more, e.g. H(k,k') > for all (k,k'), however we show 
below that maximizing ([29]) over {p, 11} subject only to (fTUj) and J2kP(k) = 1 already generates 
the desired result: {p, 11} = {p(c), 11(c)}. Extremizing (|29p with the Lagrange formalism, leads 
to the following equations, which are to be solved in combination with (|1U|) and J2kP(k) = 1: 

v(t ' *> : wm mc) - n(c);p - nl = g m mh) (w) £ tW)W - f) - l ) (35) 

fi / \ 

(36) 




dp(k) 

in which {X(£)} and /x are Lagrange multipliers. Working out (f35l) gives 

p{k)Ii{k,k')p{k') _ p(k\c)U(k,k'\c)p(k'\c) p(k)k 
V(k,k): - _ — — (37) 

Since both U(k,k') and LT(A;, A;'|c) must satisfy the constraints (jlOp . with degree distributions 
p(k) and p(k\c), respectively, it follows from (|37p that 

X(k) = \p{k)k (38) 

With this expression we eliminate \{k) from (|37|) to find 

y . p(k)Il{k,ki)p{k') = p(k\c)U(k,k'\c)p(k'\c) 
(k) k(c) 



Next we work out (|36l) and substitute (|38p into the result. This gives, using symmetry of II: 
Vk : p(k\c) = up{k) + ||| X>(A/)&TI(fc', k) = ( M + i)p(fc) (40) 

The normalization conditions J2kP(^\ c ) = J2kP(^) = 1 then tell us that /U = ^, so 
p(/c) = p(/c|c) for all k, and finally also (via (|39p ): 

V{k,k'): n(k,k r ) =n(k,k'\c) (41) 

Hence, the choice {p, LT} = {p(c), 11(c)} indeed extremizes the leading two orders in N of (|27p . 
subject to (jlOp and to normalization of p(k). The above extremum must be a maximum, since 
by making pathological choices for {p, LT} (viz. choices inconsistent with the structure of c) we 
can make prob(c|p, Q) arbitrary small, and hence f2[p(c), 11(c); p, LT] arbitrarily small. Hence 
our canonical ensembles are indeed self-consistent in a Bayesian sense, as expected. 
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3.4- The random graphs ensemble as a conditioned maximum entropy ensemble 

In this section we show that our canonical ensemble gives the maximum entropy within 
the subspace of graphs with prescribed degrees and upon imposing as a constraint the 
average values H(k,k') = (Tl(k,k'\c)) of the relative degree correlations. First we define our 
constraining observables, i.e. the degree sequence and the re-scaled degree correlation: 

fci(c) =h (Vi) (42) 

q(k, k'\c) = N' 1 CijSkM^k'Mc) (k, k' > 0) (43) 

ij 

Note that if iV -1 J2i ^fe,fci(c) = p{k) and (k) = J2kP(k)> then 

^-Sw**^) forA ^°° (44) 

We are interested in the maximum entropy random graph ensemble p(c) (limited to symmetric 
graphs without self-interactions) such that q(k,k') = Sc^K )?^ ^'(c) f° r an an d 
k{ = ki(c) for all i. This is given by the ensemble p(c) for which the Shannon entropy 

S[Kq] = ^2p(c\k,q)logp(c\k,q) (45) 

c 

is maximal subject to our constraints. Extremization of (|45p with Lagrange multipliers gives, 
without enforcing p(c) > explicitly, 

Vc: ^^|&(^)[ to gKcO + Ao + E A ( fc » fc'I^^O (46) 

Vc: logp(c)+A + J2Kk,k')q(k,k'\c) + l = (47) 
kk' 

Vc : p(c) = - e -E kk iMk,k') q (k,k'\c) ( 48 ) 

Vc : p(c) = - e - JV " 1 E 4 i^A(* i (c) ) fc J (c)) (49) 

with Z such that 2Dc 7J ( c ) = 1- As expected for an ensemble of random graphs with maximum 
entropy, where a set of averages of obervables are constrained to assume prescribed values, 
the result of the extremization gives an exponential family, where the parameters {A(fcj, kj)} 
are to be calculated from the equations for the constraints. What is left is to show that the 
exponential family can be reduced to the micro-canonical ensemble (|17|) . where degrees are 
prescribed, by a simple redefinition of the Lagrange multipliers. Let us first rewrite (|49p 



Vc : p(c) = l(He-r%WMiMW)([I^ (c) ) (50) 



i<j 



Vc : p(c) = l(n [e-V-HHW+HM)^ + ^, ]) (IIW)) ( 51 ) 



We can then redefine our Langrange multipliers in terms of the function Q(k, k') via 

/LA p -A/- 1 [A(fc i ,fc j )+A(fcj,fc i )] 



N 1 + e --W _1 [A(fci,fej)+A(fcj,fcj)] 

This results in 

(k)Q{ki, kj t 



Kc) = ^ n (i 



2: 11 V AT 
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The first product in ([52]) only depends on the constrained degrees {/cj} (in fact, to leading order 
this dependence is only via their average (k), smce]J i< j(l — (k)Q(ki,kj)/N)^ 1 = e N( - k ^ 2+ °^), 
so it drops out of the measure, and hence (]52p can be rewritten as 



1 



p{c) = zaroyn ^QfaWcvA+ii-^QfakMscvfl nwi ( 53 ) 
z(k,g) = ^n[l#^i)^,i + (i-^q(^>%))^,o1 n^A(c) (54) 

which indeed reduces to ([T7]) . as claimed. 
5.5. Shannon entropy 

The (rescaled) Shannon entropy of the canonical ensemble Prob(c|Q*,p), as defined by 
Q*(k, k') = IL(k, k')kk'/(k) 2 in combination with ([IB]), is an important quantity as it allows us 
to define and calculate the effective number of graphs M\p, II] in the ensemble: 

S]p, n] = - l^Prob(c|p,Q*) logProb(c|p,Q*) (55) 

C 

Af[p,II] =e NS ^ (56) 

In (]55p one defines as always OlogO = lim e |o e l°g e = 0. For large iV we can use our earlier 
results (]23|27I29|) to find the leading orders of the entropy, since 

5b, n] = £Prob(c|p,Q*)n(c|p,Q*) 

c 

= ^(k)[log[N(k)]-l] - Y,P(k)logkl 

k 

- £ Prob(c|p, Q*)n[U(c),p(c); II, p] + o(l) 

c 

= i<fc> [log[iV</c>] — l] - log fc!-5>(A;)logp(fc) 

k k 

- E P(fc) ^ )fcfc/ n(fe, k>) log n(fc, fcO + (i) 



= i(fc)[log[iV/(A;)] + l] -X;p(*)logbWM*)l 

- E^M^'n^, fe') log n(fc, fc') + o(i) (57) 

where 7r(fc) denotes the Poissonian degree distribution with average degree (k), viz. 7r(fc) = 
{k) k /k\. To prove various properties of the above expression for the entropy it will be 
convenient to introduce a new (symmetric) quantity W(k, k'), defined as the probability that a 
randomly drawn link in a graph that has II(fc, k'\c) = Tl(k, k') connects two nodes with degrees 
k and k'. It can be shown to be related to II(/c, k') via 

W(k, k') = p{k)p(k')kk'U(k, k')/(k) 2 (58) 

Irrespective of its exact meaning, the crucial mathematical advantage here of working with 
W(k, k'\p, II) is that it represents a probability distribution: W(k, k') > and J2kk' W(k, k') = 
1 (normalization follows from (|10p ). One also verifies explicitly that W(k) = J2k' W(k,k') = 
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p(k)k/(k) for all k. If we use (|58|) to eliminate H(k, k') from (|57p in favour of W(k, k') we get 

s[ P ,n] = i(fc)[io g [iV/(fc)] + i] -J2p(k)iog\p(k)Mk)] 

k 

~ 2 ( k ) £ W(*> lQ g fcO/WfaWO] + o(l) (59) 

fefc' 

The term in (|59|) with PF(/c, fc') is seen to be proportional to minus the mutual information 
between two connected sites, and is therefore non-positive, vanishing if and only if II(fc, k') = 1 
for all (k,k'). Furthermore, the term in (|59p involving ir(k) is minus a KL-divergence, and 
therefore also non-positive, vanishing if and only if p(k) = n(k) for all k. Our result (|59p 
therefore has a clear and elegant interpretation: 

• For the simplest graphs of the Erdos-Renyi type, where only the average degree (k) 
is imposed, one has p(k) = ir(k) for all k and U(k,k') = 1 for all (k,k'). This gives 
W(k,k') = W(k)W(k'), and the entropy takes its maximal value: 

S\p,IL] = ~{k)[log[N/(k)}+l] (60) 

• For graphs where the degree distribution p(k) is imposed, but without further 
structure (i.e. still Il(k,k') = 1 for all (k,k')), the entropy decreases by an amount 
J2kP(k) l°g[p(^)/ 7r (^)] which is the KL-distance between the imposed p(k) and the 
Poissonian degree distribution with the same average connectivity: 

s[ P ,u] = i(fc)[iog[j\r/(fc>]+i] -£p(*) lo gb(*0M*0] (si) 

• For the more sophisticated graphs where both a degree distribution p(k) and 
nontrivial degree correlations defined via H(k,k') are imposed, one no longer 
has W(k, k') = W(k)W(k') and the entropy decreases further by an amount 
\{ k )Y.kk> W(k,k')log[W(k,k')/W(k)W(k')], which is proportional to the mutual 
information regarding degrees of connected nodes: 

S[p,U] = ±(k)[log[N/(k)]+l] -^2p(k)log\p(k)/Tr(k)} 

k 

~l( k )Yl W ( k > lo § [ W ( k > k')/W{k)W(k')\ (62) 
kk' 



4. Quantitative tools for networks 

The availability for any given/observed network c of a well-defined canonical random graph 
ensemble, that produces random graphs with microscopic topologies controlled solely by the 
observed degree statistics and degree correlations of the given c, allows us to develop practical 
quantitative tools with which to analyze and compare (structure in) real networks. Here we 
focus on three such tools. 



4-1. Quantifying structural network complexity 

The natural definition of the complexity of a given network c is based on the number JV[p, II] 
of graphs in its canonical ensemble {p, II}, and hence on the entropy per node S\p, II] given in 
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([59]) . It makes sense to write this entropy for large N as S\p, H] = Sq — C[p, IT] + o(l), with a 
first (positive) contribution Sq = ^(k)[log[N/(k)+X\ that originates simply from counting the 
total number of bonds and would also be found for structureless Erdos-Renyi graphs (where 
only the average degree is prescribed), minus a second term C\p, II] which acts to reduce the 
entropy as soon as there is structure in the graph beyond a prescribed average degree. This 
latter quantity C\p, II] can be identified as the complexity of graphs in the canonical ensemble 
associated with c, and hence as the complexity of c: 

c[ P ,u] = 5>(A;)iog[p(A0A(fc)] + ^&(%(£0^ , n(MOiogn(M') (63) 
k kk' 

where ir(k) is the Poissonian distribution with average degree (k): 

7r(fc) = e - {k) (k) k /k\ (64) 

The larger C\p, II], the more 'rare' or 'special' are graphs with characteristics {p, II}. For every 
N, the complexity is bounded from above by (|60p ; at this value the network undergoes an 
entropy 'crisis', as (162p vanishes and the degree distribution ceases to be graphical, i.e. no 
network can be found with this degree distribution (see [22] for the notion of graphicality) . 
Note, however, that our results were obtained in the limit (k) <C N; they no longer apply 
for degree distributions with an average connectivity of the order of the system size. For e.g. 
fully connected graphs, where the complexity is maximal, the entropy should vanish, whereas 
(|62p indeed yields an incorrect 0{N) result. As an illustration one may check how close to the 
entropy crisis are PPIN of different species (PPIN typically meet the requirements (k) <C N 
for our theory to apply). For this purpose we have computed the (|62p for protein interaction 
networks of different species and show the results in Fig. [TJ A more systematic and extensive 
application of our tools to PPIN will be published in [16] . 



4-2. Quantifying structural distance between networks 



In the same spirit we can now also use our tailored graph ensembles to define an information- 
theoretic distance Dab between any two networks ca and cb, based solely on the macroscopic 
structure statistics as captured by their associated (observed) structure function pairs {pa, ITl} 
and {pb,T1b}- The natural definition would be in terms of the Jeffreys divergence (i.e. the 
symmetrized KL-distance) between the two associated canonical ensembles, which is non- 
negative and equals zero if and only if {p^jH^} = {pb,Hb}, i.e. if the graphs ca and eg 
belong to the same canonical ensemble: 

Dab = ^t^ Prob(c|p j4 , Qa) log 

1 



+ 



2N 



^Prob(c|p£},Q s )log 



Prob(c|p s ,<2s 
Prob(c|p B ,(5 B ) 



Working out this formula, using (|2 

- Pmb(c\p A , Qa)^{c\pb, Qb 



Dab 



Prob(c|pA, Qa) 

and ([59]) . gives for large TV: 
i 

-S\pa,Ha] 



+ 1^2 Prob(c|p B , Q B )n{c\p A , Qa) ~ \s\p B , n fl ] 



1 



Yp A (k) log 



\ PA(k) 
VBik) 



+ Y J PA{k) ! l ^' )kk ' u A (k,k')io g 



\n A (k,k') 



kk' 



4(fc>, 



+ o ^2 PB(k) log 



PB(kh 

PA(k)\ 



. ^PB(k)p B (k')kk' , 
+ 771XZ u B[k, k ) log 



U B (k,k') 
U B (k,k' 



kk' 



4(fc) 



B 



U A (k,k') 



(65) 



(66) 



o(l) 
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Figure 1. Shannon entropy per node S[p, II] (markers connected by solid lines) and 
complexity C [p, II] (markers connected by dashed lines) of the canonical ensembles 
tailored to the production of random graphs with microscopic topologies controlled 
solely by the degree sequence and degree correlation of experimentally determined 
PPINs. The methods/sources for the experimental data sets are the following: BGD, 
BioGrid database; Y2h, yeast two-hybrid screen; PMs, purification mass spectrometry; 
HPRD, human protein reference database; DI, data integration (database with 
combined experimental data); PCA, protein fragment complementation assay. The 
studied organisms are listed in alphabetical order on the x-axis. Data sets properties 
and references are summarised in Table [Tj 



This quantity is used in [16] for comparing and clustering PPIN data sets, even if these differ in 
size, solely on the basis of their degree sequence and degree correlations. The combination of its 
information-theoretic origin and explicit nature (so that it involves almost no computational 
cost) makes (j66[) an efficient practical tool in bio-informatics. 

4-3. Numerical generation of canonical 'null models' 

We have shown that for any given network c it is possible to define a tailored ensemble 
of graphs, that share with c those structural aspects that follow directly from its degree 
distribution and degree correlations, and used it to define and calculate complexities and 
structural distances. Our next aim is to use the ensemble for generating random graphs with 
structure {p, 11} identical to that of a given network. The problems associated with generating 
complex random graphs with controlled properties are well known [2 ^[Ml [25 l [26 | [27 1[28l[29l[5D] . 
In [T7] a general method was proposed for generating random graphs with built-in constraints 
and specific statistic weights, such as described by the invariant measure (|16p . in the form of 
a Monte-Carlo process that is guaranteed to evolve from any initial graph Co that meets the 
relevant constraints towards the prescribed invariant measure (|16p . The initial graph Co can 
be constructed by hand, for any choice of p(k), such that for sufficiently large N it will have 
the required degree statistics (see e.g. [3T] ). With the general and exact algorithm [T7] we 
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Figure 2. Results of Markov chain graph dynamics proposed in [17] tailored to 
generating equilibrium random graph ensembles with specific degree sequences and 
specific degree correlations, (a): Colour plot of the relative degree correlations 
n(A:, fc'|c) as measured in the Escherichia coli PPIN (here N = 2457 and (k) = 7.05). 
(b): colour plot of H(k,k'\c') in the synthetic graph c' generated with Markov chain 
dynamics targeting the measured degree correlation if the PPIN, after 67, 147 accepted 
moves, (c): colour plot of H(k,k'\c') in the final graph generated with dynamics 
targeting II(fc, k') = 1 V (k, k'), after 1,968,000 accepted moves. 



can generate graphs according to the measure (|16p . with the kernel Q(k,k') of (|3ip chosen 
such as to impose any desired degree correlations Tl(k,k'). These graphs can then serve as 
'null models', allowing us, for instance, to determine to what extent specific small motifs in 
biological networks (such as short loops) can be regarded as mere consequences of the overall 
structure dictated by their degree statistics and degree correlations, or whether they reflect 
deeper biological principles. See [16J for the results of such tests. 

Here we generate, as an illustration, a synthetic network which is to have the same degree 
sequence and the same degree correlations as the protein interaction network of Escherichia 
coli, as given in [32], (i.e. we produce a member of the tailored graph ensemble of this particular 
PPIN), where N = 2457 and (k) = 7.05. The degree correlations of the resulting graph after 
67,147 accepted moves of the Markov chain algorithm of [T7] are shown in figure [2(b) , and are 
seen to be in very good agreement with the degree correlations of the PPIN that are being 
targeted, displayed in figure [2(a) (note that there is no need to compare degree distributions, 
since all degrees are guaranteed to be conserved by the graph dynamics [E]). To rule out the 
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possibility that the observed similarity in degree correlations between the synthetic graph and 
the original PPIN could have arisen from poor sampling of the microscopic configurations (and 
just reflect direct similarities in the connectivity matrices), we also calculated the Hamming 
distance between the connectivity matrices c and c' of the original PPIN and the synthetic 
graph, 

(the prefactor is chosen such that when the two matrices differ in all the 2N(k) entries which 
could be different, then p(c, c') = 1). The Hamming distance vanishes if the two matrices are 
identical. In the present case we find p = 0.90, which implies that although our two graphs 
have similar macroscopic structure, their microscopic realizations are indeed very different. 

For comparison, we also show in figure Etc) the degree correlations of a synthetic graph 
obtained via the Markov chain dynamics of [T7], starting from the same initial graph, but now 
targeting degree correlations described by H(k, k') = 1 for all (k,k'). All residual deviations in 
the bottom plot of figure [2] from the objective Tl(k, k') = 1 V(A;, k') are due to finite size effects. 
Again we also calculate the Hamming distance between the original and the synthetic matrix, 
giving p = 0.93. This value is similar to the one found previously, but now the macroscopic 
structure of the synthetic graph in terms of the degree correlations is considerably different 
from the underlying PPIN. 

It has been noted by several authors that most PPINs are disassortative, i.e. nodes 
with high degrees tend to connect with nodes with low degrees Measures of degree 
assortativity have been proposed in [3j [U [33]. A conventional measure of assortativity is 
the correlation coefficient ((kk') — (k)(k'))/((k 2 ) — (k) 2 ), calculated over the joint distribution 
W(k,k') in (|58p . Degree-assortativity has been shown to have important consequences on 
both the topology of a network and the process which it supports. In particular, it was shown 
that assortative networks are more resistant to random attacks, i.e. random vertex removal, 
whereas disassortative networks are less resistant [3]. It may be useful from a practical point of 
view to generate networks with a prescribed assortative character. This can again be achieved 
by using the measure (|16p . where the kernels Q(k,k') are now chosen to produce assortative 
or disassortative graphs. In [T7] it was shown that the kernel 

\k-kf 

m 2 ) - (kf) 

tailors the ensemble (I16D to the production, for large N, of graphs with degree correlations 

, „ (k)(k-k') 2 , N 

1 ' ; [a 3 - 2a 2 k + ai k 2 ][a 3 - 2a 2 k> + ai k> 2 } { } 

where the three coefficients ai are to be solved numerically from 

1 ^ a 3 - 2a 2 k + aik 2 [ ' 

This degree correlation has a disassortative character. In fact, any kernel of the form 

Q(k, k') = C~ l \k - k'\ n , n = 1, 2, . . . (71) 

with C such that J2k k' P(k)p(k')Q(k, k') = 1 will tailor the ensemble (fT6|) . for large N, to 
the production of graphs with increasingly negative assortative coefficients as n increases. A 
prototype of an assortative kernel would be 

Oft*) + 1*- W (72) 



0(fc,fc') = ^7T^ ^T2T ( 68 ) 
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where C = J2k k' P(k)p(k')[l + \k — k'\ n \. For sufficiently large N, the predicted values for 
U(k,k') follow from (|2ip . where F(k) is to be solved numerically from (|22p . As an example 
we generated two synthetic graphs, both with the same degree sequence as the PPIN of Homo 
sapiens (the experimental data used was taken from the human protein reference database 
(HPRD), [M]). In the first graph we enforced an assortative connectivity using (|72p with 
n = 1, and in the second one a disassortative connectivity using (17ip with n = 1. Both graphs 
were generated with the algorithm of [T7j, starting from the actual Homo sapiens PPIN. In 
Fig. Eta) we show the colour plot of the relative degree correlations Tl(k,k') as measured in 
the Homo sapiens PPIN, and in Fig. [3^c) and E^e) we show the same quantity in the two 
synthethic graphs generated. For comparison we also show (Fig. [3|b) and[3jd), respectively) 
the functional H(k, k') that are being targeted, via the kernels in (|72p and (|7ip . 

5. Discussion 

In this paper we have studied the tailoring of a particular structured random graph ensemble 
to real-world networks. We have first derived several mathematical properties of this ensemble, 
including information-theoretic properties, its Shannon entropy, and the relation between its 
control parameters and the statistics and correlations of the degrees in the network to which 
the ensemble is tailored. We were then able to use the mathematical results in order to 
derive explicit and transparent mathematical tools with which to quantify structure in large 
real networks, define rational distance measures for comparing networks, and for generating 
controlled null models as benchmark graphs. These tools are precise and based on information- 
theoretic principles, yet they take the form of fully explicit formulae (as opposed to implicit 
equations that require equilibration of extensive graph simulations). We therefore hope and 
anticipate that they will be particularly useful in bio-informatics; indeed a subsequent paper 
will be fully devoted to their application to a broad range of protein-protein interaction 
networks, involving multiple organisms and multiple experimental protocols [16J. 

Let us turn to the limitations of this study. Our work so far has focused on characterizing 
network structure macroscopically at the level of degree distributions and degree-degree 
correlations, and was limited to undirected networks and graphs. We therefore envisage two 
main directions in which the present theory could and should be developed further. The 
first, and relatively straightforward, one is generalization of the analysis to tailored directed 
random graph ensembles. Here one does not envisage insurmountable obstacles, and it would 
in bio-informatics open up the possibility of application to e.g. gene regulation networks. 
The second direction is towards the inclusion of measures of macroscopic structure that take 
account of loops, such as the distribution of length-three loops in which individual network 
nodes participate. Here the mathematical task is much more challenging, since in entropy 
calculations it is no longer clear whether and how one can achieve factorization over nodes. 
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Figure 3. Colour plots of the relative degree correlations II(fc, k') of networks which 
all have the degree sequence of the Homo sapiens (from the HPRD database) PPIN 
(with N = 9463 and (A;) = 7.4). (a): II(fc, fe'|c) as measured for the Homo sapiens 
PPIN. (b): the target assortative function H(k,k') given in (f72l) . (c): the actual 
function Xl(k : k'\c') measured after 203,441 accepted moves of the Markov chain in 
|17j . on the right, (d): the target disassortative function H(k,k') given in ([7T|) . (e): 
the actual function n(fc,fc'|c') measured after 266,763 accepted moves, on the right. 
These results confirm the efficiency of our canonical graph ensemble and its associated 
Markov chain algorithm, in generating controlled null models. 
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Table 1. Maximum degree fcmax, detection method/source and reference for the 
biological network data sets. The detection methods/sources are abbreviated as in 
Fig. ffl 
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Appendix A. 

Degree correlations in the random graph ensemble 

In this appendix we prove the validity of the crucial relation (|2ip . with U(k,k') as defined in 
(1201) for the random graph ensemble (|16h : 

n(M0 = V (k)t(k>)kk> ifeo^ [n^)]^.^^4E Prob (c|k,Q)c rs (A.l) 

Let us work out the sum over the graphs c in (lA.lj) . using the integral representation 
<>nm = (27r) -1 Jq W du e M«-- m ) ^ Q j ea j w ^h fa e _/y d e g ree constraints 5ki,k t {c)- This introduces 
and iV-fold integration over cj = (u>\, . . . ,u>n) £ [0,2-^]^. With a modest amount of foresight 
we introduce the two abbreviations u ■ k = J^i^i^i and 

k 

N' 



i<3 



W(u,k) = H{l + j-Q( ki ,k j )[e- i ^+^-l}} 
These allow us to write 
^Prob(c|k,Q)c 



(A.2) 



c rs Yii<j 


^Qiki^^S^t + ^l-^Qik^kjfjS^fi 




rii<j 


^Q(fci,*!j)*cy,l+(l-^( fc i> A; i)) <y «y,0 


• lit *fc<,fci(c) 



/dwe <w - k £c<V.n i<J -{ 


#Q(fei,%)^,i+(l-#Q(^,%)) 


Sc i:j ,0 




Jdue^EcUi^i 


^Q{h,kj)5 Cih i + 


(l-jlrQfakj)) 


S <Hj,0 


e -iCij(u)i+u)j) | 



Jdu W(u,k)e 



l+±Q(k r ,k s )[e-^r+^s)-l] 



Jdu W(w,k)e iw - k 

We next expand the function W(a;, k), as defined in (|A.2|) . in leading orders for large N, using 
the abbreviation P(q, o;|o;,k) = N~ 1 J2i$q,k^( u; ~ 

W(u>,k) = Hexp^Qik^k^e-^^-lj + OiN- 2 )} 



r k 



-i(u>i+LUj) _ 



1]+0(1)} 



exp {~kNj2 J duoduj 1 P(q, u\u, k)P(q', J\u,k)Q(q, q') [e"*^') - 1] + 0(1)} 
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We now insert the following representation of unity, for each combination of (q,u), 

1 = J dP(q, u)6[P(q, u) - P(q,u\u, k)] 

_ f dP(q, uj)dP(q, u) jNPtq ,u>)[P(g ,u>)-P(g ,a>|u>,k)l I A k\ 

~ J 2tt/N 6 (A - 5j 

and convert the previous expression for W(u>,k) into the form of a functional integral, with 
a path integral measure {dP} = Y\ q ^[dP{q, uj)Alo / 'V2tt] (where the values of w 6 [0, 27r] are 
first discretized, with the discretization spacing Ao> sent to zero as soon as this is possible): 

W(u,\s) = J{dPdP}e lN ^J duJ p ^)P(q^)-iEi p ^*)+om 

x e ^ N Y, qg 'I dujd ^' P(q^)P(qW)Q(q,q')[e-^ + "">~i] 

= J{dPdP}e N ^ [{P ' P}]+ ^ [{p}] ^~ i ^ p ^ l)+ ° ( - 1) (A.6) 



with 



*[{P,P}] =i£ / cLo P(q,u)P(q,u) (A.7) 
®[{P}] = l^dudJ P(q,u,)P(q>,u;')Q(q,q>)[e-^ + ^ - 1] (A.8) 

2 g q' J ° 



We can now integrate over the iV-fold angles u G [0, 2ir] , and obtain 

Jdu W(u,k)e^ k ' = J{ d PdP}e N ^ p ^ + ^ p ^ +0 ^ Jdu e^'-^HM 

= J {dPdP}e N (^ p ^ + ^ p ^ + °^ Hjdco jW-KkiV)] (A.9) 

i 

and write the ratio of integrals in (|A.3j) as 

jdu e M,v - i ( Ur+u JW(u>,k) _ 
Jdu e iu ^W(u,\i) ~ 

I [ fdue^ k r -iP(k r ,u)] \ e iuks-iP(k a ,u) J 



f{dPdP}e N (^ P ' p K+^ p V +n tt p ^ +0 ^ 

(A.10) 

with 

n[{P}\k] = i lo § / dw e*^**-^**^ (A.ll) 

i 

Therefore we find upon combining the previous intermediate results that the quantity of 
interest (jA.ip can be written in the following form: 

r r dPd pi ej v(^[{P,P}] + ^[{P}] + n[{P}lk]) + 0(i) f U± e^-H^ ]][ Jdw s.^-p^ . 



J{dP(i J P}e Ar ( vI '^ P '^]+ ,I> ^ p >] +n [^>l k 0+ C) ( 1 ) 

jk) 2 Q(k,k') 
kk 1 
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lim 



J1 ; I [JdueH" fc-P(k.»)]][/dw e ikfc'-F(fc', W )]] J 



J{dPdP}e Ar ( VI '[-t p ' / '>] + *['t p >] +n [^}])+ c, ( 1 ) 



where 



(A.12) 
(A.13) 



We conclude from (|A. 121) . in which the functional integrals can be done by steepest descent 
in the limit N — > oo, that takes the form 

n(*, k') = Q(k, k')/F{k\Q)F{k'\Q) (A.14) 

with 

1 (k) JcLu e Mk-l)-iP(k^) 



F{k\Q) k fduj e ^k-iP(k,uj) 



(A.15) 



and where the functions P(k, u) and P(k, u) are to be solved from extremization of ^[{P, P}] + 
^[{P}] +^[{P}]) with the three functions given in (|A.7IA.8IA.13p . leading to the two coupled 
functional saddle-point equations 6[® + $\/6P = and + Q,]/5P = 0. 

The last step in this appendix is to derive from the saddle-point equations an equation for 
the function F(k\Q) in (|A.14|) . Upon transforming exp[— iP(k, u)] = R(k,u), our saddle-point 
equations simplify to 



R(k,uj) = ex V {(k}J2jduj' P{k\u')Q{k,k')[e- i{ - w+ ^ -I]} 



P(k,u) =p(k)- 



R(k, u>)e 



iujk 



' Jdu' R(k,uj')e iuj ' k 

Elimination of P(k,u) from this set gives, using the identity J dco P(k,uj) = p(k), 

= exp { ^p(k')Q(k, k')e-^k'/F(k'\Q) - G(k\Q)} 



(A.16) 
(A.17) 



(A.18) 



in which F(k\Q) is defined in (|A.15|) . and G(k\Q) = {k)J2k' p(k')Q(k, k'). Insertion of our 
expression for R(k,u>) into (|A.15|) . using exp[— iP(k,uj)] = R(k,ui), leaves us with an equation 
for F(k\Q) only from which the object G(k\Q) simply drops out since it gives an identical pre- 
factor exp[— G(k\Q)] in both the numerator and the denominator of the formula for F(k\Q): 
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(A.19) 
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Equivalently: 

F(k\Q) = {k)- l Y,P{k')k'Q{k, h>)F-\k!\Q) (A.20) 

Note that the present derivation of the combined result (|A.14|A.20p also serves as the explicit 
proof of the validity of corrigendum [21] . 



